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Description 

IMAGE ANALYSIS SYSTEMS FOR 
GRADING OF MEAT, PREDICTING 
QUALITY OF MEAT AND/OR PREDICTING 
MEAT YIELD OF AN ANIMAL CARCASS 

Cross Reference to Related Applications 

[0001] This patent application is a divisional application of U.S. 
Patent Application No. 09/977,641, filed October 15, 
2001, currently pending, which application is hereby in- 
corporated by reference. 
Background of Invention 

[0002] Field of Invention 

[0003] The invention relates to automated grading of meat and 
predicting meat yield and quality of meat from an animal 
carcass and, more particularly, to capturing images of 
meat portions of an animal carcass and processing infor- 
mation in the image for grading of meat and predicting 
meat yield. 



[0004] Background Art 

[0005] Grading of animal carcasses for the purpose of predicting 
meat yield and quality is an important aspect of the meat 
processing industry. Meat grading has historically been 
performed by a human grader. To perform the meat grad- 
ing process the human grader will typically examine key 
physical aspects of the carcass. The type of grading being 
performed determines what physical aspects of the car- 
cass need to be examined by the grader. The two main 
types of meat grading for a carcass are quality grade and 
yield grade. The quality grade describes the meat's 
palatability or tenderness. Whereas, yield grade describes 
the proportion of lean boneless meat that a given carcass 
will yield. 

[0006] | n the meat industry, it is common for the human grader 
to examine various physical aspects of a cross section of 
the Longissimus dorsi (commonly referred to in beef as 
the Vibeye' and in pork as the 'loin eye') for both yield 
grading and quality grading. In a typical beef processing 
facility after the animal has been slaughtered, head re- 
moved and skinned, the carcass is further disassembled 
by splitting the carcass in half along the midline. The car- 

th 

cass is then 'ribbed' or severed between the twelfth 12 



and 13 ribs thereby exposing for examination and grad- 
ing a cross section of meat or a cutting surface of meat, 
which specifically includes the ribeye and associated sub- 
cutaneous fat. For quality grade, the human grader will 
typically examine the 'marbling' (intramuscular fat). For 
yield grade, the human grader will typically examine the 
area of the ribeye cross section and the thickness of sub- 
cutaneous fat adjacent to the ribeye at various points 
around its area and adjust the fat thickness based on fat- 
ness of the entire carcass. For yield grade, the human 
grader also utilizes parameters such as hot carcass weight 
and percentage kidney, pelvic and heart fat for determin- 
ing yield grade. 

[0007] Grading by a human grader is typically based upon the 
human grader's perception of the appearance of the rib- 
eye. Photographs can be utilized as standards for deter- 
mining grade. Photographs are used for training for qual- 
ity grade, but are not typically used for grading. This pro- 
cess clearly introduces a substantial amount of subjectiv- 
ity into the meat processing industry. The Human Grader's 
subjectivity is problematic because this grading deter- 
mines the valuation of animal carcasses and therefore 
clearly effects the financial bottom line. 



[0008] Yield grade is typically denoted by a numerical value from 
1 to 5 based upon the yield from the carcass of boneless, 
closely trimmed (approximately 0.25 in.), retail cuts from 
the round, loin, rib and chuck. An accurate yield grade for 
these four wholesale cuts of meat is extremely important 
to an accurate valuation of the carcass, thus reducing the 
amount of subjectivity is desirable. These four wholesale 
cuts make up approximately 75% of the weight, and about 
90% of the carcass value. Regression equations for carcass 
grading have been developed from actual carcass data us- 
ing factors such as fat thickness at the twelfth ribeye 
cross section, ribeye area and carcass weight. However, 
the regression equations are not practical for a human 
grader to utilize during actual everyday grading of a car- 
cass in a production facility. Therefore, working formulas 
have been developed which make certain adjustments to 
the yield grade based on the same type of factors utilized 
by the regression equations. However, this process still 
results in a substantial amount of subjectivity. 

[0009] | n order to reduce operator subjectivity, automated in- 
strumental grading systems have been developed. For ex- 
ample, various type of image analysis grading systems 
have been developed, which capture and analyze digital 



images of portions of a carcass. The image analysis sys- 
tems typically examine parameters similar to or identical 
to the type of parameters examined by a human grader. 
Typically the image analysis systems try to determine and 
distinguish portions that are lean and portions that are fat 
and their respective areas. To distinguish meat portions 
(i.e. lean or fat; ribeye muscle or non-ribeye muscle sur- 
rounding ribeye) the image analysis system will typically 
utilize parameters such as color and contrast. 
[0010] it j S typical for the image analysis to be performed on the 

th 

12 ribeye cross section. However, regardless of the sec- 
tion of meat that is being analyzed, there are various 
problems in utilizing image analysis to characterize the 
features of the meat. For example, the muscle or the lean 
area of interest can be surrounded by other lean areas 
with minimal fat separation, which is typically true of a 
ribeye cross section. Therefore, it is often difficult for the 
image analysis system to distinguish between the muscle 
of interest and the adjacent muscle because the dimen- 
sions and shape of a given muscle type may vary consid- 
erably from carcass to carcass. Another example is that a 
muscle of a given carcass may have large areas of intra- 
muscular fat, whereas that same muscle type for another 



carcass may not have the large area of intramuscular fat. 
This is problematic because it is difficult due to the intra- 
muscular fat to determine where the desired muscle ends 
and the adjacent muscle begins. Dense marbling can also 
make it difficult to determine the border or the cross sec- 
tion area of the muscle of interest. Yet another example is 
distinguishing color transitions from fat to lean. Color 
distinction is critical particularly with dense marbling and 
large areas of intramuscular fat because digital analysis 
algorithms often look for continuous adjacent pixels of 
the same color to determine if a red or lean region of the 
image is within the area of the desired muscle. Due to the 
above problems many image analysis systems have diffi- 
culty identifying the correct area of the desired muscle 
and then appropriately analyzing the image. 
1 ] Image analysis of the ribeye poses unique problems par- 
ticularly in a production meat processing environment 
where the ribbed carcass halves are graded for quality and 
yield. In a typical production meat processing facility, par- 
ticularly beef processing, the halved and ribbed beef car- 
cass travels through the grading area suspended from a 
conveyor hook by the achilles tendon. The ribbed section 
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of the carcass partially exposes the 12 rib cross section. 



The cross section is not fully exposed for ease of viewing 
because the ribbing incision is minimized such that the 
carcass stays intact. If the ribbing incision is too deep the 
head portion of the carcass will separate from the hind 
portion due to weight and gravity. Therefore, due to the 
minimized incision, it is sometimes difficult even for the 
human grader to get a clear view of the cross section for 
grading purposes without physically manipulating the car- 
cass to obtain a better view. It is even more difficult to in- 
sert a camera in the incision to capture a good image 
consistently that has adequate lighting, minimal shading, 
and with minimal angular distortions of the image. Ob- 
taining a good and consistent image must be achieved 
prior to even addressing the problems of image analysis 
identified above. However, obtaining a high quality image 
is difficult and most systems are inadequate, particularly 
with the inconsistent and non-uniform lighting found in 

most facilities. 
Summary of Invention 

[0012] The invention is an image analysis system and method for 
grading of meat, predicting quality of meat and/or pre- 
dicting meat yield of an animal carcass. One embodiment 
of the invention is particularly designed to capture an im- 



age of the 12 rib cross section of the carcass side and 
perform image analysis of the ribeye for grading pur- 
poses. The image capturing camera portion of the system 
has a substantially wedged shaped camera housing for 
ease of insertion into the ribbed incision. The image cap- 
turing portion of the system further comprises a camera 
with a flash for consistent lighting. The camera is posi- 
tioned such that it views the ribeye cross section at an an- 
gle to accommodate the wedge shape of the camera 
housing for ease of insertion in the incision. The camera 
housing also has various alignment means to facilitate the 
user's ability to capture images in a consistent manner. 
Once the image is captured either digitally or captured 
and converted to a digital image, an image analysis is 
performed on the digital image to determine parameters 
such as the total area of the ribeye, total fat area, total 
lean area, percent marbling, and thickness of subcuta- 
neous fat adjacent to the ribeye. The image analysis algo- 
rithm performs multiple steps to obtain the desired pa- 
rameters. The steps include, geometrical correction for 
angular distortions particularly due to the wedge shaped 
camera housing, shading correction, image flip when pro- 
cessing the compliment (right) side of carcass, first adap- 



tive color segmentation for fat and lean color distinction, 
erosion and dilation, second adaptive color segmentation 
and contour determination. The adaptive color segmenta- 
tion is one novel aspect of the invention that provides for 
distinct color separation for lean and fat thereby facilitat- 
ing defining the total ribeye area, total fat area, total lean 

area and percent marbling. 
Brief Description of Drawings 

[0013] For a better understanding of the present invention, refer- 
ence may be made to the accompanying drawings. 

[0014] pig. 1 is a perspective view of the image capturing camera 
assembly. 

[0015] Fig. 2 is a side cross sectional view of the image capturing 
camera. 

[0016] Fig. 3 is a front cross sectional view of the image captur- 
ing camera. 

[0017] Fig. 4 is a functional diagram of the overall system. 
[0018] Fig. 5 is a flow diagram of the image analysis algorithm. 

[0019] Fig. 5a is a representation of using an ellipse to calculate 
a new center of gravity and a second ribeye contour. 

[0020] Fig. 5b is a representation of the method of cutting unde- 
sired corners and edges. 



[0021] pig. 6 is a detailed flow diagram of the color segmentation 
portion of the algorithm. 

[0022] pig. 7 is a detailed flow diagram of the contour determi- 
nation portion of the algorithm. 
Detailed Description 

[0023] According to the embodiment(s) of the present invention, 
various views are illustrated in Figs. 1-7 and like reference 
numerals are being used consistently to refer to like and 
corresponding parts of the invention for all of the various 
Figs, of the drawing. The first digit(s) of the reference 
number for a given item or part should correspond to the 
Fig. Number in which the item or part is first identified. 

[0024] The present invention is an image analysis system and 
method for grading of meat, predicting quality of meat 
and/or predicting meat yield of an animal carcass. This 
system and method is designed to be utilized in a meat 
processing facility, specifically those related to beef pro- 
cessing. The system and method is designed to capture 
an image of an exposed ribeye cross section of a halved 
ribbed beef carcass. The system is specifically designed to 
enable the user to consistently capture a quality image of 
the ribeye cross section by inserting a wedged-shape 
camera into the incision of the ribbed carcass. Once the 



image is captured, the present invention performs an im- 
age analysis of the digitized image for grading of the beef 
carcass. The following description and drawing should 
clarify the detailed operation of at least one embodiment 
of the invention. 

[0025] Referring to Fig. 1, a perspective view of the image cap- 
turing camera assembly is shown. The image capturing 
camera assembly 100 is designed with a substantially 
wedge-shaped form factor to facilitate insertion into the 
ribbed incision. The image capturing camera comprises an 
ergonomically designed handle 102 which further com- 
prises a trigger or switch communicably linked to the 
camera and flash, not seen in this view, refer to Fig. 2, 
item 212, for triggering the shutter of the camera for cap- 
ture of the image with the camera and also triggering or 
flashing the camera flash. 

[0026] The image capturing camera assembly 100 has a substan- 
tially wedge-shaped housing 106 having a height that ta- 
pers from a taller back end 101 to a shorter front end 
103. The taper is formed by a tapered or sloped top, and 
the bottom is substantially flat. The bottom has an open- 
ing or viewing window designed for positioning over a 
ribeye cross section or other meat part for viewing and 



capturing an image. One embodiment shown in Figs. 1-3 
is a twohousing design comprising a front nose portion 
109 and a rear portion 110. The rear portion 110 of the 
housing is where the camera is housed and mounted and 
the front nose portion 109 is for insertion into the incision 
of the ribbed carcass. For the embodiment shown in Figs, 
lthe nose portion is generally a polyhedron having a sub- 
stantially wedgeform factor. The top 111 and bottom 107 
of the nose portion of the housing intersect forming a 
blunt edge such that there is an oblique dihedral angle 
between the top and bottom giving the nose portion a 
substantially wedge shape. The nose portion further com- 
prises an opening or viewing window on the bottom. The 
sides 105 of the nose portion are canted inwardly toward 
one another from bottom to top in order to facilitate the 
user's viewing around the camera housing. One benefit of 
a separate front nose portion is the ease of removing and 
cleaning. 

[0027] The front nose portion is firmly attached to the rear por- 
tion 110 where the camera is mounted and the handle 
102 is attached. The rear portion also has a generally 
polyhedron form factor. The rear portion is attached to 
the front nose portion in such a manner that the camera 



mounted therein is angled downward directing its field of 
view toward the opening or viewing window on the bot- 
tom side of the front nose portion. The top 116 of the 
rear portion is generally aligned with the top 111 of the 
front nose portion to provide a substantially consistent 
taper to the overall top. The sides 118 of the rear portion 
are canted inward toward one another from bottom to top 
similar to the sides 105 of the front nose portion. The 
bottom 120 of the rear portion forms an oblique dihedral 
angle with the bottom side 107 of the front nose portion 
to assist in achieving the appropriate angle of the camera 
mounted therein. The camera and its mounting can also 
provide a portion of or all of the desired angling. The re- 
sulting form factor of the overall twohousing is a substan- 
tially wedgeform factor. The camera wedge-shaped hous- 
ing is designed to form a hood over the camera assembly 
including, camera, camera flash and electronics so that 
the field of view includes only the object of interest and 
standardizes the distance between the camera lens and 
the object of interest. The housing 106 is designed with a 
large enough opening such that the camera has a full view 
of the ribeye cross section. The hood or housing 106 has 
a substantially wedge shape such that is can be easily in- 



serted into the ribbed carcass and adequately aligned. The 
housing 106, in addition to having an overall wedge shape 
top to bottom, also has inwardly tapered sides 105, 118 
in order to reduce the size of the housing while not ob- 
structing the field of view of the camera. The tapered 
sides are designed to improve the user's view of the rib- 
eye. 

[0028] The camera housing design has other alignment features 
that facilitate the user's ability to repetitively capture high 
quality (high definition, clarity, sharpness) images. For ex- 
ample, the camera housing is flat on the side of the open- 
ing. This flat underside or bottom 107 of the camera 
housing allows the user to place the camera housing flush 
and flat against the cutting surface and particularly 
against the surface of the ribeye cross section so that the 
appropriate viewing angle of the camera is achieved when 
the image is captured. Another example of an alignment 
feature for the camera housing is the first and second 
stud guide extensions 108, 104 (104 not shown in this 
view, see Fig. 2) on either side of the opening or viewing 
window of the camera housing and the studs extend be- 
low the exterior surface of the bottom for side to side po- 
sitioning. These stud guides facilitate a consistent align- 



ment of the camera by preventing side-to-side motion of 
the camera. 

[0029] The camera housing also has a backstop guide extension 
or an alignment plate 112 which should consistently con- 
trol the depth of insertion of the camera into the incision 
of the ribbed carcass for capturing an image of the ribeye. 
This guide provides for front to back alignment and as 
shown one embodiment of the guide extends below the 
bottom surface. The camera housing can be inserted into 
the incision until the backstop guide abuts the edge of the 
incision. The camera assembly 100 also has a communi- 
cation line 114 capable to carry digitized images that have 
been captured. The camera opening or viewing window 
can be rectangular in shape and large enough to encom- 
pass the entire ribeye cross section. The rectangular 
opening or viewing window also defines a field of view 
obtainable by the camera. The front nose portion of the 
housing can be further designed to have an upper hood 
portion, which is removably attached to the base portion. 
If a transparent material is utilized for the viewing window 
or if there is simply an opening, the removable upper 
hood portion facilitates cleaning. 

[0030] Referring to Fig. 2, a side cross sectional view of the im- 



age capturing camera assembly 100 is shown. The cross 
sectional view reveals the angular positioning of the cam- 
era 202 for optimal viewing through the opening 204 or 
viewing window of the housing. The positioning of the 
camera to view the ribeye cross section is driven by the 
wedge-shaped housing design and the position of the 
viewing window 204. The angle of the camera also mini- 
mizes back reflections into the I ens of the camera. The 
downward canted angle of the camera is such that field of 
view 206 of the camera is canted downward and the view- 
ing angle 208 creates an oblique angle of incidence 210 
at the viewing window such that almost all reflections 
from the attached camera flash will travel away from the 
lens and be absorbed by the substantially non-reflective 
interior of the camera housing. This is particularly impor- 
tant if a transparent material, such as glass, covers the 
opening, however, the viewing window can simply be an 
opening. If the viewing window is simply an opening, a 
transparent material such as glass can be installed over 
the opening of the rear portion 110 vertically along seam 
216. This material will isolate the camera and electronics 
from contaminants. Also, if a transparent material is in- 
stalled along seam 216. The camera 202 can be moved 



closer to the transparent material to avoid reflection back 
into the lens. This configuration has advantages in that 
the transparent material does not make contact with the 
object for which an image in being captured. The viewing 
angle and field of view are angled such that the field of 
view of said camera at least subtends the entire view of 
the viewing window 204 such that an image of the cutting 
surface seen through the viewing window is fully cap- 
tured. 

[0031] The camera can be a digital camera. The digital camera 
utilized can be any type of color digital camera providing 
adequate resolution. A color analog camera can also be 
utilized but the analog image must be digitized by a 
frame grabber function which requires additional camera 
circuitry. Optionally, the frame grabber circuitry can be 
part of an image analysis computing system in lieu of be- 
ing part of the camera circuitry. The camera can also be 
designed with a camera image output operable to output 
an image captured by the camera for input to an image 
analysis computing system. 

[0032] Referring to Fig. 3, a front cross sectional view of the im- 
age capturing camera assembly is shown. One embodi- 
ment of the invention is shown with a camera 202 having 



a circular camera flash 304 that extends around sur- 
rounding the lens 306 of the camera. The circular flash 
design provides for uniform lighting when the image is 
being captured. To obtain uniform lighting, the camera 
flash need not be circular. The camera flash can optionally 
extend substantially around the lens of the camera. For 
example, the flash could have multiple flash element seg- 
ments which substantially surround the lens in a substan- 
tially symmetrical pattern. 
[0033] For prevention of glare due to the flash, the opening to 
the housing can optionally be covered with a glare resis- 
tant window made of glass or some other transparent ma- 
terial. The window prevents undesired material getting in- 
side the camera housing through the opening. The win- 
dow is removably mounted over the opening such that it 
can be removed for cleaning. Also, as discussed above, 
the housing is preferably a two-piece housing comprising 
a rear portion and a front nose portion, where both the 
front nose portion and rear portion can each optionally 
have an upper hood portion and base portion, where the 
upper hood portion of the housing is removably mounted 
to the lower base portion of the housing. The ability to re- 
move the upper hood portion of the housing allows for 



the upper hood portions to be removed such that the as- 
sembly can be readily cleaned. The special housing design 
of the camera shelters the camera from the surrounding 
ambient light environment. The housing provides for a 
self-contained environment for capturing an image of the 
ribeye. This self-contained environment, along with the 
camera flash, provides adequate uniform lighting for the 
camera when capturing the image. The housing also limits 
the field of view of the camera. 
[0034] Referring to Fig. 4, a functional diagram of the overall im- 
age analysis system is shown. The system comprises the 
image capturing camera assembly 100 as described in 
Figs. 1-3 for capturing an image of the ribeye cross sec- 
tion. The camera contained therein could be an analog 
camera or a digital camera. However, if an analog camera 
is utilized, additional circuitry is required to digitize the 
image prior to, or subsequent to transmitting the image 
to the image analysis computing station 402. The image 
capturing camera has a camera image output integral with 
communication line 114 for transmitting the image out to 
an image analysis, computing system. The image analysis 
computing station performs the image analysis function 
by executing an image analysis algorithm. The execution 



of the image analysis algorithm analyzes the image and 
identifies various parameters that are utilized for grading 
the carcass. The algorithm then grades the carcass based 
on the parameters identified. A monitor 404 can also be 
communicably linked to the image analysis computing 
station by way of a CPU 406 for displaying the image cap- 
tured. The algorithm can be further operable to display 
the image on a monitor in a color coded format to identify 
the various lean portions and fat portions of the image. 
The system can also present a real time image on the 
monitor as seen by the camera when the user is position- 
ing the camera over the ribeye, which may facilitate posi- 
tioning the camera to assure the entire ribeye is in the im- 
age. Stud guide extensions 108 and backstop guide 112 
are also used for alignment. The stud guide extension can 
be positioned on either side of the cutting surface for 
side-to-side alignment. The front end nose portion of the 
camera housing assembly can be inserted into the incision 
until the backstop guide 112 abuts the edge 408 of the 
incision. The stud guides and backstop guide can be posi- 
tioned such that when the camera assembly is inserted in 
the ribbed incision, the viewing window is positioned rela- 
tive to the ventral side of the ribeye and the same features 



of the cross section are consistently captured. For exam- 
ple, the viewing window can be positioned in a medial lat- 
eral direction. The image and the related data can also be 
stored on the image analysis computing station for future 
reference. The image analysis computing station can be a 
customized computing station or any personal computer 
with adequate processing and memory to perform the im- 
age analysis function. 
[0035] Referring to Fig. 5, a flow diagram 500 of the image anal- 
ysis algorithm is shown. The image analysis algorithm 
performs a method for grading a beef carcass. The 
method as shown in Fig. 5 accommodates the camera de- 
sign by correcting geometric distortions, shading and in- 
tensity. One embodiment of the camera design creates a 
geometric distortion because the image is captured at an 
oblique angle. Intensity and shading anomalies also result 
from the angle of camera and the housing design. Based 
on the design of the camera, the image has distortion in 
the x and y directions. The reason for the angle is the 
acute wedge shape of the housing and the position of the 
viewing window. Due to the housing, the camera is angled 
downward such that its field of view can subtend the 
viewing window. The substantial wedge shape of the 



housing is ideal because it provides a very small nozzle 
like end of the unit which can be inserted in the incision 
and placed on the ribeye even if the ribbing incision is im- 
proper. The shading anomaly occurs because a camera 
flash light is used to provide good contrast between the 
ribeye and the background image. However, due to the 
angle between the light and the ribeye surface light shad- 
ing in the image results. The level of intensity in certain 
areas of the image may have anomalies for the same rea- 
sons. Therefore, both the distortion and the shading have 
to be corrected. 

[0036] The image input functional block 501 is operable to input 
the image from the image capturing system or camera. 

[0037] The geometrical correction functional block 502 is repre- 
sentative of the functional step for correcting the image 
due to angular distortion caused by the viewing angle of 
the camera. A mathematical correction of the image based 
on the known angle of the camera transforms the image 
to correct the x and y directional distortion. The parame- 
ters for this transformation can be used for every image 
taken by the camera. Methods for correcting x and y di- 
rectional distortions are well known in the art. For exam- 
ple, an image can be captured of grid lines contrasted 



against a white background with the camera assembly. 
The grid lines are parallel in both the x and y directions 
and spaced an equal distance apart. When the image is 
captured, the grid lines are distorted in both the x and y 
directions. A mathematical algorithm can be developed to 
correct the grid lines in the image. This algorithm can be 
utilized to correct other images. 
[0038] The shading correction functional block 504 is represen- 
tative of the step of correction for shading anomalies. A 
mathematical correction of the image transforms the 
shading image into an approximately equally intense im- 
age over the complete image area. Methods for correcting 
for shading anomalies are well known in the art. For ex- 
ample, an image can be captured of a white uniform 
background with the camera assembly. When the image is 
captured, shading anomalies will likely result. A mathe- 
matical algorithm can be developed to correct the shading 
returning the image to a uniform white. This algorithm 
can be utilized to correct other images. The parameters 
are predetermined based on the angle of the camera and 
flash and the shape of the housing for the shading correc- 
tion and these parameters can be used for every image 
taken by the camera. 



[0039] The flip image if right carcass side (compliment side) 
functional block 506 is representative of the step that 
flips the image if a compliment side carcass is being ex- 
amined. For one embodiment of the invention the algo- 
rithm can be designed to work with ribeyes of a left car- 
cass side. If there is a right carcass side the image can be 
flipped and the analysis works as it would for a left car- 
cass side. Methods are well known in the art for distin- 
guishing an image from its compliment or in this case 
distinguishing an image of the left carcass side from an 
image of the compliment right carcass side. For example, 
an algorithm can be developed to distinguish between the 
direction of a given taper of a portion of an object and its 
compliment. See U.S. Patent 5,944,598. issued August 31, 
1999 to Tong et al. 

[0040] The scale correction to pre defined intensity level func- 
tional block 507 is representative of the function to cor- 
rect overall intensity and contrast. The image is scaled to 
a pre defined intensity while maintaining or improving the 
relative contrast. The area is analysed for the pixels with 
the highest intensity. If the intensity of these pixels are 
lower than a predefined level where said predefined level 
is optimized for a given camera's flash, resolution and 



contrast ratio, then the whole image is transformed in a 
way that the highest intensity pixel has the pre defined 
intensity level and all other pixels with lower intensities 
are linearly transformed to their corrected relative inten- 
sity. This step improves images with low light by increas- 
ing the contrast and brightness. 
[0041] The first adaptive colour classification functional block 
508 performs the first color segmentation step for the 
image. The aim of the colour classification function is to 
separate and categorize the pixels of the image into a 
component of Background (almost black), Fat (almost 
white) or Lean (almost red) in a three dimensional colour 
space R,G,B (red, green, blue). To establish the three start 
points in the RGB color space for the respective colour 
classifications, the brightest and darkest areas in the im- 
age will be analyzed and the lightest area will be analyzed 
to establish the start point for fat and the darkest area will 
be analyzed to establish a start point for the Background. 
Analyzing the darkest and lightest areas to establish the 
respective start points can be as simple as determining 
the darkest or lightest pixel or pixels within the respective 
areas and using as a start point or determining the center 
of gravity of each of the respective areas and using as a 



start point. Also, please note that the lightest and/or the 
darkest areas can be as small as a single pixel if the algo- 
rithm is so designed. The start point for the lean will be 
estimated in this first adaptive colour classification step to 
be between the two start points of fat and Background (for 
example, 0.5 of the vector distance between the two 
points). Once the three start points are established, the 
nearest neighbour method is utilized to decide for each 
point or pixel of the image if it is a point of the class 
Background, Fat or Lean. If a pixel has nearly the same 
distance between two of the start points for instance be- 
tween fat and lean then that pixel is classified as un- 
known. Classifying the pixels having nearly the same dis- 
tance as unknown is necessary because for some meat 
cuts the overall color range of fat may overlap with the 
color range of lean, thus, the difference between the dis- 
tances to the start points may be too close to classify. For 
example, a criterion could be if the shorter distance is not 
less than 80% of the longer distance, then the distances 
are considered nearly the same and the pixel is classified 
as unknown. After the first color classification step is per- 
formed all pixels are sorted (or classified) in the four 
classes background, lean, fat or unknown. 



[0042] The preliminary outside contour functional block 510 per- 
forms the step of determining a first preliminary outside 
contour. The result of the first color classification step is 
utilized to analyze the outside contour of the cutting sur- 
face. This function is performed by examining each pixel 
coming inward from the image border and determining if 
there is a gradient between a pixel of the class Back- 
ground with a neighbor pixel which is not background 
(lean, fat or unknown). Each gradient point establishes an 
outside contour point. A successful completion of this 
step establishes a starting point for the contour analysis. 
Each pixel coming inward from the image border is exam- 
ined pixel by pixel for the same gradient once around the 
complete object such that the result gives the outside 
contour. 

[0043] The first erode and dilate functional block 512 represents 
the erosion and dilation steps to further define the con- 
tour. Once the first preliminary outside contour has been 
established an erosion and dilatation of this preliminary 
outside contour is performed to eliminate little attach- 
ments on the outside contour like fat, bone or lean parts. 
This step is performed by iteratively eroding the contour 
by iteratively shrinking the outside contour a pre deter- 



mined number of times to a contour inside the last con- 
tour (erode) and after that by enlarging with same number 
of iterations a contour outside the last contour. One 
method of eroding the outside contour is to iteratively 
erode the exterior most pixels that form the last outside 
contour pixel-by-pixel and layer- by- layer a predeter- 
mined number of times. The number of times is deter- 
mined and optimized based on the resolution of the cam- 
era, the typical overall area of the meat cut being exam- 
ined, the typical area of surrounding fat and surrounding 
lean, and the typical number and size and contours of 
lean. For example, a camera having a moderate resolution 
of 768x572 pixels can require 10 times erosion when 
analysing a typical ribeye. Dilation is then performed the 
same number of times by dilating pixels immediately ad- 
jacent the last contour. After the dilation step, little at- 
tached parts are excluded from the preliminary outside 
contour of the cut surface to establish a new outside con- 
tour. Various erosion/dilation techniques that are well 
known in the art can be utilized. 
[0044] The centre of gravity of the new outside contour func- 
tional block 514 is representative of the step to determine 
the center of gravity of the new outside contour. The cen- 



ter is located nearly always in the ribeye. 
[0045] The measurement of actual lean color functional block 
516 is representative of the step to determine the true 
adaptive start point for lean color in the ribeye, which is 
the second adaptive color classification. Around the center 
of gravity a rectangular subarea can be measured with a 
predetermined size. Defining this predetermined size 
subarea to have a rectangular geometry can be done for 
simplicity, however, a subarea having any geometry can 
be used. The size of the rectangle (or subarea having any 
other geometry) is determined and optimized based on 
the resolution of the camera, the size of the object or 
meat being examined and what is reasonably large 
enough to obtain a good sampling for color determination 
yet staying within the area of the object or meat of inter- 
est. For example, for a camera having a resolution of 
768x572 pixels capturing a ribeye image, a rectangle 
sized which will encompass 50x50 pixels can be suffi- 
cient. The adaptive start point for the color of the lean is 
then determined by only measuring the color of pixels in 
that rectangle, which have a color classification class 
"Lean". In other words, all pixels with the class Fat or Un- 
known within that rectangular are not used to calculate 



the average lean color. This is very important in cases 
where within the rectangle there is a lot of marbling or the 
rectangle is somewhat located in a fat area (can happen 
on very fat animals). With this method it doesn't matter 
because only lean pixels are considered. 

[0046] The second adaptive color classification output functional 
block 518 is representative of taking the adaptive start 
points and calculating certain parameters because now an 
adaptive start point for the lean is established rather than 
the previous estimate in the first adaptive color classifica- 
tion. The first color classification only provided adaptive 
start points for fat and Background. The classification it- 
self is the same method as previously performed but with 
full adaptive start points. This adaptive classification gives 
us the final segmentation of the cutting surface into back- 
ground, lean, fat and unknown. 

[0047] The following parameters can now be calculated by a clas- 
sification area function in this step: 

[0048] total area of cut surface 

[° 049 ] total lean area 
[0050] total fat area 
[0051] total unknown area 



[0052] The determination of a first ribeye adaptive contour func- 
tional block 520 starts from the center of gravity examin- 
ing the pixels looking for a gradient between lean and fat/ 
unknown/background using the adaptive color classifica- 
tion now established. The gradient searched for is be- 
tween lean to something else (non-lean). Once a start 
point is established the method goes around the object to 
analyze the contour thereby defining the first ribeye con- 
tour. If the resulting contour is too small to be a ribeye we 
look further until we find a contour with reasonable size. 
The limits (min and max) are predetermined adaptively 
based on the size of the preliminary outside contour. De- 
ciding whether a contour is too small can be determined 
by comparing the size of the preliminary outside contour 
to what the typical ribeye size is for a cut surface having a 
given preliminary outside contour. This step is needed to 
be assured that it is the ribeye contour and not the con- 
tour of an adjacent muscle. 

[0053] The ellipse into the ribeye functional block 522 is repre- 
sentative of the step to calculate a new center of gravity 
from the first ribeye contour. From the previously estab- 
lished center of gravity the method extends outward in 
four directions (north, south, east and west) until the rib- 



eye contour (see Fig. 5A, Item 540) is hit as represented in 
Fig. 5A by lines 542, 544, 548, and 546 respectively. This 
provides a horizontal and vertical size of the inside of the 
first ribeye contour. By using a predetermined factor (for 
example, 0.5) to these dimensions as identified by 550, 
552, 554, and 556 of Fig. 5A, we put an ellipse 558 
around the center of gravity. This ellipse is created using 
the 0.5 factor in order to never hide the ribeye contour. 
Other factors could be utilized when appropriate, particu- 
larly for other meat cuts. Inside the ellipse all fat classed 
pixels are changed to be classed Lean. This helps to clear 
at this step a lot of marbling for a better ribeye contour 
search in the next steps. (Later for marbling determination 
the cleared fat areas are used again so there is no missing 
marbling.) An ellipse is utilized in this functional step be- 
cause an ellipse closely approximates the shape of a rib- 
eye, however, other closed curve geometries can be uti- 
lized. 

[0054] The determination of the second ribeye contour functional 
block 524 performs a similar operation as functional block 
520 determining a second adaptive gradient, but with the 
ellipse around the center only has lean classified pixels 
inside when determining this second ribeye contour. 



[0055] The second erode and dilate functional block 526 per- 
forms the same type of erosion and dilation as performed 
by functional block 512, but for the second adaptive rib- 
eye contour instead of the preliminary outside contour. 
With this method we cut off attached muscles. However, 
this dilatation differs from block 512 in that this dilation 
will go with a higher number of steps than the erosion to 
lay a band around the ribeye for the third ribeye contour 
search. This may be necessary due to the loss of accuracy 
of the contour due to erosion. 

[0056] The determination of the third adaptive ribeye contour 

functional block 528 performs the same function as func- 
tional block 520 determining a third adaptive gradient. 
However, the ellipse around the center has only lean clas- 
sified pixels inside the ellipse and the attached muscles 
are cut off. 

[0057] The search for corners/edges functional block 530 cleans 
up any undesired attached adjacent muscle that remains 
after functional blocks 524 to 528 have been performed. 
The method examines the third adaptive ribeye contour 
looking for corners (see Fig. 5B, 560) that may indicate an 
undesired attached muscle in the following way. An actual 
location on the ribeye contour where there is an outward 



protruding contour is identified and on either side of the 
contour first and second straight lines (see Fig. 5B, 562 
and 564) are utilized to linearly approximate the curve of 
the contour and the lines have a predetermined length 
and the lines are positioned on the ribeye contour in a 
frontward and backward manner such that they intersect 
forming an angle 566. The predetermined length must be 
long enough to adequately approximate the typical con- 
tour. For example, when utilizing a camera having a 
768x572 pixel resolution for capturing a ribeye, first and 
second approximation lines 20 pixels long should be long 
enough to approximate and intersect. For example, the 
angle between the lines should be approximately 180° or 
a substantially flat contour. If the angle between the lines 
is smaller than a predetermined level (90°) then the 
method assumes an undesired corner where there could 
still be an undesired attached muscles. The predetermined 
90° angle could vary depending on the meat cut. Along a 
predetermined angle from the corner point we search now 
for an opposite contour point 568 that would cut off the 
attached muscle. The corner point is determined from the 
intersection of the two lines. However, before the method 
cuts off the corner/edge the method can preferably check 



different plausibility factors that should indicate if the 
corner is an undesired attached muscle or not. If the plau- 
sibility factors indicate undesired muscle, the method cuts 
off the undesired muscle using a circular pattern to cut off 
the corner/edge leaving a circular contour or a curved cut 
line. One plausibility factor could be examining the ratio 
between the square of the lengths of the curved cut line 
over the area cut off. If the ratio is small, then the area 
being cut can be large relative to the ribeye area which 
can verify that it is an adjacent muscle. If the ratio is large, 
then the area being cut can be small relative to the ribeye 
area which can indicate it is not an adjacent muscle. A 
second plausibility factor could be the length of the 
curved cutting line relative to the height of the ribeye. For 
example, if the cutting line is longer than the typical 
quarter of the height of a ribeye, then it is likely an adja- 
cent muscle. A third plausibility factor could be the num- 
ber of lean pixels as compared to the fat pixels in the cut 
off area. If a much larger percentage of fat pixels, then 
this may verify the likelihood of cut off area being adja- 
cent muscle. Once the corners/edges function is com- 
plete, the final ribeye contour is defined. 
[0058] The counting lean and fat pixels in ribeye functional block 



532 calculates the following parameters: 
[0059] ribeye area 

[0060] | ean area j n ribeye 

[0061] f a t area in ribeye 

[0062] unknown area in ribeye 

[0063] number of fat objects in ribeye 

[0064] average size of fat objects 

[0065] number of gradients between lean and fat horizontal and 

vertical in the ribeye 
[0066] correction of number of fat areas (big fat pieces are not 

counted) 

[0067] color measurement of all lean pixels for lean color 

[0068] The fat strip functional block 534 determines a subcuta- 
neous fat area positioned between 5/8 and 7/8 along the 
axis of the ribeye and orthogonal to the ribeye contour 
and the following parameters are calculated: 

[0069] area of fat 

[0070] average fat thickness 

[0071] 0 nce the above parameters have been calculated, the al- 
gorithm can insert the parameters into regression formula 



for calculating meat quality and yield grade 
[0072] Referring to Fig. 6, a flow diagram of the color segmenta- 
tion portion of the algorithm is shown. This flow diagram 
outlines the adaptive method for color classification of 
pixels within the image. This adaptive method is impor- 
tant because the color of lean and fat can vary from car- 
cass to carcass. For example, some carcasses may have a 
ribeye cross section where the lean portion is a darker red 
than other carcasses. Another example is that the fat sur- 
rounding the ribeye cross section of a beef carcass can 
sometimes have a reddish hue as opposed to other car- 
casses where the fat is closer to a true white. The variation 
in lean and fat color from carcass to carcass make it diffi- 
cult to predefine a color range for fat or lean. Therefore, 
this adaptive method was developed to allow color classi- 
fication to adapt to the lean color and fat color of a given 
carcass. The functional flow diagram in Fig. 6 outlines the 
steps in the algorithm for this adaptive color classification 
method. Functional blocks 602 and 604 search the image 
to locate the brightest and darkest areas of the image. 
The color of the brightest area is utilized to define the 
start point or center point in the RGB color space for pix- 
els to be classified as fat pixels. The color of the darkest 



area of the image is utilized to define the start point or 
center point in the RGB color space for pixels to be classi- 
fied as background pixels. The color start point in the RGB 
color space for lean will be estimated to be between the 
two start points for fat and background. The functional 
steps for establishing the start points in the RGB color 
space is defined by functional blocks 606 and 608. Func- 
tional block 610 represents the nearest neighbor func- 
tional step which classifies each pixel as lean, fat, back- 
ground or unknown. The pixels are classified based on the 
closest start point in the RGB color space. However, if a 
given pixel is nearly the same distance to at least two of 
the start points, then the pixel will be classified as un- 
known as outlined above. Once the color classification is 
completed, the outside contour of a cutting surface is de- 
termined as represented by functional block 612 and fur- 
ther, functional block 612 determines the center of gravity 
based on the outside contour determined in this step. 
Functional block 614 defines a rectangular subarea about 
the center of gravity determined by functional block 612 
and determines the average lean color within the rectan- 
gle, thereby redefining the lean color start point within the 
RGB color space. As noted above, a subarea having any 



geometry can be utilized. Functional block 616 represents 
the adaptive reclassification of the start points for lean, 
fat and background in the RGB color space. This method 
provides a more accurate color classification than other 
methods currently utilized. An accurate color classification 
is critical for the steps of defining the contour using the 
method of detecting a gradient from one classification to 
another. 

[0073] Referring to Fig. 7, a detailed flow diagram of the contour 
determination portion of the algorithm is shown. Func- 
tional block 702 represents the functional step of deter- 
mining the preliminary outside contour by starting from 
the border of the image working inward and detecting 
gradients between background and non-background pix- 
els. Once the preliminary outside contour has been de- 
fined utilizing the gradient method of functional block 
702, erosion and dilation of the image is performed by 
functional block 704. Once the first erosion and first dila- 
tion 704 occurs, a new outside contour is defined and fur- 
ther, functional block 706 defines the center of gravity 
based on that new outside contour. Functional block 708 
is representative of determining the first ribeye contour by 
starting from the center of gravity and working outward 



looking for gradient between lean and non-lean thereby 
defining the first ribeye contour. A new center of gravity is 
determined based on the first ribeye contour and this 
functional step is represented by functional block 712. 
Functional block 718 defines an ellipse about the new 
center of gravity and within the ellipse defines all pixels as 
lean. This facilitates determining the contour of the lean 
utilizing gradients. This is performed by starting from the 
center of gravity and working outward to determine gradi- 
ents between the all lean pixel within ellipse and non-lean 
pixels. This gradient method is defined by functional 
block 720 which determines and defines a new second 
ribeye contour. Functional block 722 performs similar 
erosion and dilation as step 704 except dilation will be 
with a higher number of steps than the erosion. A third 
ribeye contour is then determined by functional block 726 
by performing a similar method as functional block 720. 
Functional blocks 728 and 730 search for contours that 
are not part of the ribeye and defines a curved cutting line 
to cut them off. Plausibility checks as outlined herein can 
be performed as represented by functional block 732. If 
Plausibility checks confirm that a contour is not part of 
ribeye, then a cut is performed as represented by func- 



tional block 734. 

[0074] The various image analysis grading system examples 

shown above illustrate a novel image analysis grading ap- 
paratus and method. A user of the present invention may 
choose any of the above image analysis grading apparatus 
or method embodiments, or an equivalent thereof, de- 
pending upon the desired application. In this regard, it is 
recognized that various forms of the subject image analy- 
sis grading invention could be utilized without departing 
from the spirit and scope of the present invention. 

[0075] As is evident from the foregoing description, certain as- 
pects of the present invention are not limited by the par- 
ticular details of the examples illustrated herein, and it is 
therefore contemplated that other modifications and ap- 
plications, or equivalents thereof, will occur to those 
skilled in the art. It is accordingly intended that the claims 
shall cover all such modifications and applications that do 
not depart from the spirit and scope of the present inven- 
tion. 

[0076] other aspects, objects and advantages of the present in- 
vention can be obtained from the study of the drawings, 
the disclosure and the appended claims. 

[0077] INDUSTRIAL APPLICABILITY 



[0078] The present invention has significant industrial applicabil- 
ity. As described herein, many meat processing facilities 
still utilize human graders to grade the quality of meat 
from a beef carcass or to predict lean meat yield from a 
carcass. However, the methods utilized by human graders 
are very subjective. This subjectivity can have an adverse 
financial effect on the meat processing facility as outlined 
herein. Due to the subjective nature of grading by human 
graders, image analysis systems have been developed to 
automatically grade the beef carcass. However, image 
analysis systems prior to this invention have had prob- 
lems reliably grading a beef carcass. 

[0079] one aspect of the present invention is its ability to consis- 
tently capture a good image of the ribeye cross section. 
This is made possible by the substantially wedge-shaped 
camera design that allows the user to readily insert the 
camera into the incision of the ribbed carcass. Also, the 
camera design includes various alignment means to facili- 
tate accurate and consistent alignment of the camera prior 
to capturing the image. The wedge-shaped camera design 
and the alignment means allow the user to consistently 
capture a good image, even when the incision of the 
ribbed carcass is shorter than the norm, making it difficult 



even for human graders to examiner the ribeye cross sec- 
tion. The wedge-shaped camera with alignment means 
makes it easy for the user to insert the camera into the in- 
cision consistently capturing good images. 

[0080] The present invention also addresses the issue of incon- 
sistent or inadequate lighting in a beef processing facility. 
The hood-shaped camera design creates an isolated im- 
age capturing environment such that a camera flash can 
control the lighting for the image. Further, the image 
analysis computing system can accommodate various car- 
casses having inconsistent lean and fat color from carcass 
to carcass. The adaptive color segmentation method of 
the present invention allows the present invention to 
adapt to each unique carcass. 

[0081] The camera housing can be manufactured in stainless 

steel making for easy cleanup. Also, the camera housing 
can be a two-piece design such that the top portion of the 
housing is removably attached to the bottom base portion 
such that cleaning can be facilitated. Also, the handle de- 
sign is economically placed and shaped for easy handling 
and positioning of the camera. The handle can be de- 
signed with an integral trigger that allows the user to trig- 
ger the shutter of the camera and the camera flash. The 



ergonomic design of the handle allows the user to manip- 
ulate and position the camera with one hand while trig- 
gering the capturing of the image with the same hand. 
[0082] The camera can be communicably linked to a mobile work 
station that comprises the image analysis computing 
means, as well as a monitor for viewing the image. The 
work station, as well as the image analysis computing 
system and monitor, can be organized appropriately for 
the meat processing work environment. The image analy- 
sis computing system could be a standard personal com- 
puter based system having the appropriate software in- 
stalled. The camera and work station design allows the 
user to operate in a production meat processing environ- 
ment while rapidly grading each carcass and storing the 
data to the image analysis computing system for later re- 
view and analysis. The present invention provides for an 
objective grading system that is designed to operate in a 
production meat processing facility and further designed 
to provide a consistent and reliable grading means. 



